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Method and system for providing a user profile 



The invention relates to a method of providing a user profile. 

The invention fiirther relates to a system for providing a user profile. 

The invention further relates to a computer program product. 



Television receivers, set-top boxes and similar systems often comprise an 
electronic program guide (EPG) which is capable of receiving and decoding data such as a 
program title or program category, related to programs and other content items which will be 
transmitted in the near fiiture. Generally, such an EPG shows a list of program titles and the 
10 clock-times, indicating at which time and by which channel the programs will be transmitted. 
Known user interfaces have the feature of keeping record of the users' preferences and 
interest. This kind of interest can be stored in a so-called user profile for a user. A user profile 
comprises metadata with several attributes, which can have values indicating the user's 
^ interest, lifestyle, and so on. A possible way of visualizing such a profile is the use of an 
jj;^ 15 agent. Such an agent can give advice, suggest programs or help in another way to let the user 
find information of interest. The agent is sometimes represented as a visual character, such as 
a talking anthropomorphic shape, which gives suggestions or advice visually and/or audibly. 
Such a visual character appeals to the user, since it allows him to interact with his user profile 
by interacting with the visual character. 
20 However, a disadvantage of such a character is that it is static and does not 

adapt to the user profile. This makes it difficult for the user to associate the recommendations 
with the character that provides them, and makes the reasons for those recommendations 
opaque to the user. 
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It is an object of the invention to provide a method of providing a user profile, 
which Eillows a user to identify himself with the user profile. 

This object is achieved according to the invention in a method comprising 
representing the user profile as a corresponding shape comprising at least one icon 
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representing a coAtent item, and guarding the consistency between the user profile and the 
corresponding shape. The consistency is preferably guarded by changing the corresponding 
shape in dependence on a change in the user profile, and can fiirther be guarded by changing 
the user profile in dependence on a manipulation of the corresponding shape. The invention 
is based on the insight that a visual representation of any form of advice should have some 
appeal to the user's taste. It then becomes possible for users to identify themselves with the 
user profile. The visual attributes of a shape are the parameters that can be subject to 
personalization. Such personalization of a user interface might help to experience more 
natural interaction. Visualization of a user profile is preferably done by means of an animated 
body. The animation, that is behaviors of the body, depends on processes inside of the body, 
in the so-called "belly", as well as outside, within the environment. 

Where user preference profiles should be taken into accoimt, these profiles 
should best be represented as sets of earlier selected items that were considered enjoyable. 
For an advisor to be taken seriously, its advises should have had high predictive values in the 
past. To this end, the corresponding shape comprises icons representing content items that 
were considered enjoyable. 

It is a fiirther object of the invention to provide a system for providing a user 
profile, which allows a user to identify himself with the user profile. . 

This object is achieved according to the invention in a system comprising user 
profile maintenance means for maintaining the user profile, visualization means for 
representing the user profile as a corresponding shape comprising at least one icon 
representing a content item, and consistency guarding means for guarding the consistency 
between the user profile and the corresponding shape. In this system, the visualization means 
ensure that users are provided with a representation of their profile with which they can 
identify. The consistency guarding means are preferably arranged for causing the 
visualization means to change the corresponding shape in dependence on the user profile 
maintenance means changing the user profile. Additionally, the consistency guarding means 
may be arranged for causing the user profile maintenance means to change the user profile in 
dependence on the visualization means changing the corresponding shape. This way, the 
consistency guarding meems can ensure that any changes to the user profile are carried 
through in the corresponding shape, and vice versa, thereby guaranteeing their consistency. 

In an embodiment the visualization means are arranged for removing an icon 
representing a content item fi-om the shape comprising said icon in response to the user 
profile maintenance means removing the content item from the user profile. A content item 
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whose relevance has decreased, can be deleted. It is then removed from the user profile. To 
guarantee the consistency, the corresponding shape must be adapted. This can for instance be 
done by generating an animation in which the icon representing the removed content item is 
removed and the shape shrinks or trembles. 
5 In a fiirther embodiment the user profile maintenance means are arranged for 

determining a subset of the content items comprised in an existing user profile, generating a 
new user profile comprising said subset and feeding the new user profile to the visualization 
means, and the visualization means are arranged for visualizing a new shape corresponding to 
the new user profile by visually splitting off the icons corresponding to the content items 
10 comprised in said subset from the shape corresponding to the existing user profile and 

visually forming the new shape. The new shape can exist as a portion of the existing shape, 
or as a new, independent shape. By splitting the shape into plural new shapes, which then act 
independently, a large user profile can be managed efficiently. Each shape provides a 
simplified view on the profile, and the user can choose to interact only with one set at a time, 
15 for example, only with movies, or only with news, etc. The profile can be split at the 

initiative of a user, for example with a button press on the remote control. The profile splits 
y according to the meta-data content description, for example into groups showing different 

Pj In a fiirther embodiment the visualization means are arranged for showing an 

iy=20 icon representing a content item, and in response to receiving an indication of a preference 
p for the content item, adding the icon representing the content item to the shape corresponding 
to the user profile and communicating said indication to the user profile maintenance means, 
the user profile maintenance means being arranged for adding the content item to the user 
profile. A content item which might be relevant for a user is offered to the user as an icon. 
25 The user can check the offer, e.g. by viewing it on his television receiver, and is then given 
an opportunity to accept or reject the offer. When the user accepts the content item, the shape 
corresponding to the user profile incorporates the icon. To the user, this represents adding the 
content item to the user profile, so this change should be incorporated in the user profile. 

The invention fiirther relates to a computer program product being arranged 
30 for causing a processor to execute the method of the invention. 



Vb5 



These and other aspects of the invention will be apparent from and elucidated 
with reference to the embodiments shown in the drawing, in which: 



< . .PHNLP00705 

4 14.12.2000 
Figure 1 schematically shows an embodiment of the system according to the 

invention; 

Figures 2a-g schematically show several possible embodiments of visual 
output as produced by the system; 
5 Figure 3 schematically shows a set of default representations for use in the 

system; 

Figure 4 shows the system according to the invention in more detail; 
Figure 5 illustrates a method of adapting the shape of a representation; 
Figure 6 shows a shape obtained with said method; 
10 Figure 7 shows a deconstruction of said shape into a series of simpler shapes 

that represent the growth path leading to said shape; 

Figure 8 shows how rules for this deconstmction are derived. 

o 

o 

1 5 Throughout the figures, same reference numerals indicate similar or 

corresponding features. Some of the features indicated in the drawings are typically 
implemented in software, and as such represent software entities, such as software modules 
or objects. 

PJ Figure 1 schematically shows an embodiment of the system 100 according to 

jU20 the invention. The system comprises user profile maintenance module 110, visualization 
jff module 120, and consistency guarding module 130. 

The user profile maintenance module 120 maintains a user profile. The 
visualization module 120 represents a content item, such as a television program, visually as 
an icon 101. The visualization module 120 represents the user profile as a corresponding 
25 shape 102 comprising at least one icon 101 representing a content item. The consistency 

guarding module 130 guards the consistency between the user profile and the corresponding 
shape 102. 

The consistency guarding module 130 preferably operates by causing the 
visualization module 120 to change the corresponding shape in dependence on the user 
30 profile maintenance module 1 10 changing the user profile. Additionally, the consistency 
guarding module 130 causes the user profile maintenance module 1 10 to change the user 
profile in dependence on the visualization module 120 changing the corresponding shape. 

A visual representation of any form of advice should have some appeal to the 
user's taste. It then becomes possible for users to identify themselves with the user profile. 
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The visual attributes of a shape, are the parameters that are subject to personalization. Such 
personalization of a user interface might help to experience more natural interaction. 
Visualization of a user profile is preferably done by means of an animated body. The 
animation, that is behaviors of the body, depends on processes inside of the body, in the so- 
5 called "belly", as well as outside, within the environment. 

The shape can be of any form, but preferably is anthropomorphic, i.e. taking a 
more or less humanlike shape or form, such as with a belly comprising the icons, and limbs 
like arms and/or legs to allow direct manipulation and visual feedback. This makes the shape 
easily recognizable and intuitive to interact with. However, the shape might also be 
10 amorphous, i.e. not having a rigidly defined form such as a rectangular or gridlike 
arrangement. 

It is beneficial to users that their profile, as mamtained by the system 100, 

^ could get a visible and interactive representation. Such representation in form of animated 

O 

O shapes that can depict user preferences is commimicative, in the sense of being able to 

Ms 

""g^ 15 communicate about internal system states and changes in information. The main interactive 
role of these user profiles is to be a direct manipulation tool for accessing content. Such a 
direct manipulation tool can enable an explicit user feedback. This way the personalization 
through adaptation might be achieved. 
PJ The idea of growing potentially infinite amount of shapes in a process of 

20 artificial evolution is a solution to the problem of personalization. In this respect the 



m 



^ personalization is understood broader than only filtered digital content delivery, and it 
includes the* appropriate visusdization for the adaptive system. 

This means that an existence of sets of liked or disliked contents is taken as a 
starting point and the problem of interactive visualization is how to show changing status of 
25 such sets, as well as how to show that different sets belong to different users, assuming that 
all users would like to identify with their own representation as well as to recognize to whom 
visible sets belong. 

The system 100 can be realized as a computer program product 140, which 
can be stored on a storage mediimi such as a floppy disc or CD-ROM, or made available over 
30 a network by a file server. The computer program product 140 will, when loaded into a 

programmable device, cause a processor in said device to execute the method according to 
the invention. The computer program product 140 enables a programmable device when 
executing said computer progrsun product 140 to function as the system 100. 
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Figures 2a-g schematically show several possible embodiments of visual 
output as produced by the system. To properly appreciate the invention, its workings will 
now be discussed in terms of the ou^ut, rather than the components. The construction of the 
system 100 will be discussed later, with reference to Figure 4. 

Figure 2a shows a visual representation 102 of a user profile and an icon 101 
representing a content item, for example, a digital TV program. The visualization module 120 
shows the icon 101 preferably when the user notifies the system that he likes the content item 
in question. The representation 102 is presented here as an anthropomorphic shape, with 
limbs and a belly comprising an icon representing a fiirther content item that is incorporated 
in the user profile represented by the representation 102. 

When the user notifies the system that he likes the content item, the content 
item is of course also added to the user profile. 

Figure 2b shows the representation 102 after several content items have been 
incorporated in the user profile. The "belly" of the representation 102 is growing big, and the 
representation 102 may have grovm more or different limbs. 

Figure 2c shows an alternative embodiment of the representation 102 
intemcting with the user. Limbs are used to visualize the changes in the user profile. For 
instance, the limbs can be use to animate the adding of the content item represented by icon 
101 to the user profile, by grasping the icon 101 and adding it to the belly of the 
representation 102. Alternatively, the representation 102 may be provided with a mouth, and 
adding can then be animated by swallowing the icon 101 in the mouth. Limbs are also seen as 
a possible way of gesture based communication with users. 

Figure 2d shows the representation 102 in which the incorporated content 
items have been grouped into two groups 103, 104. The groups 103, 104 can be distinguished 
by some criterion, for instance by genre or television channel. The representation 102 as 
shown in Figure 2c shows two news programs in the first group 103, and four movies in the 
second group 104. 

Figure 2e shows the representation 102 fi-om which a new representation 105 
has been split off. The user profile maintenance module 110 can determine a subset of the 
content items comprised in an existing user profile and generate a new user profile 
comprising said subset. This new user profile is then fed to the visualization module 120, 
which then visualizes the new shape 105 corresponding to the new user profile by visually 
splitting off the icons corresponding to the content items comprised in said subset firom the 
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representation 102 corresponding to the existing user profile and visually forming the new 
representation lOS. 

In Figure 2f , an icon is removed from the representation 102. This is 
visualized by generating an animation of a trembling representation 102, which may also 
shrink in whole or in part to visualize that its "belly" grows smaller. The icon may be 
removed because the user explicitly requested it, for example by voting negatively on the 
content item corresponding to the icon being removed. This is then communicated to the user 
profile maintenance module 110, which removes the content item in question from the user 
profile. The user profile maintenance module 110 may also have determined that the content 
item in question is no longer relevant and eliminate it from the user profile. This is then 
communicated to the visualization module 120, which performs the visualization described 
above. 

Figure 3 shows a set of default representations. Visual adaptation of the 
interface is achieved by introduction of a set of default representation, from which users can 
select the preferred one, the one which will indicate tiie direction of evolution of individual 
user profile. 

The final shape of a representation depends not only on the style chosen by a 
user, but it is also determined by behaviors, which depend on environmental circumstances, 
such as the spatial arrangement of content, which might provoke a quicker growth of some 
limbs and atrophy of others. 

This means that even if each "embryo" will have encoded a possibility of 
growth of, say, at most five legs, it is not necessarily the case that it will grow all of them, 
neither what precise shape and size they will be. The coded features of possible growth - that 
is "genes" result from the parameterization of shapes. The approach to parameterize shapes 
for growth is described in details below. 

Separately to largely impredictable growth, representations will have defined 
behaviors to conmiunicate in a natural way about their current status. This means, that they 
will be allowed to grow, for example a hand to be able to wave, if a filtering agent will find a 
piece of content relevant to user preferences. 

Figure 4 shows the system 100 in more detail. Content source 402 delivers 
information related to content items such as television programs, world-wide web docimients, 
literature, and so on. 

The user profile maintenance module 110 holds the user profile 403, a 
collection of items P that were enjoyed in the past and possibly also a collection of items Q 
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that were disliked in the past. It further comprises a filter 404 that compares the relative 
distances D(N,P) and D(N,Q), for new incoming items N. Any new incoming item is passed 
by this filter 404 and the outcome of the relative distances triggers the subsequent behaviors 
of the user profile maintenance module 110, which are generated by behavior generating 
module 405. If this distance is sufficiently small, for instance if it is less than the distance 
D(N,Q) between the new item and items Q that are assimied to be outside the user's user 
profile 403, the system 100 could conclude that it is worthwhile to recommend N to the user; 
otherwise, a negative advice should be given. Gradual changes in the user's profile 403 could 
lead to the removal of old items or to replacement by other items. Also these updates give 
rise to visual behaviors, which might require user feedback. 

At a high level, a behavior consists of rather complex motion pattems, each 
motion pattern associated to one type of database update or one primitive interaction clause. 
At a lower level, these behaviors are decomposed in terms of primitive motion primitives: 
waving a tentacle, grasping an icon, jumping up and down to draw attention, and so on. 
These low-level motions are generated in motion generating module 406. Structure module 
407 represents the articulated 'body' topology of the representation; it represents all kinetic 
degrees of fi-eedom. However, the components in the structure module 407 are not directly 
visible: they could be seen as skeletons. The actual geometric shape of the various parts that 
adorns these skeletal elements in many possible ways is determined in shaping module 408, 
and the visual quality in the form of color schemes, textxires and (faked) illumination effects 
is added in rendering module 409. As in the example of Figure 2, the total animated images 
may contain both the synthesized moving creatures and iconic material that represents the 
current user profile 403. The motions of the animated creatures should drive the placement of 
these icons, and icon placement module 410 manages this. Notice that it gets its contents 
from the current state of the user profile. 

The rendered animated advisor-creature and the iconic material that represents 
the current user profile 403 is shown on display device 412 that may or may not fomi a 
physical unity with the display device that shows the actual visual contents 413, for example 
a TV screen, a virtual book or an LCD screen. 

The user can fiirther be provided with a direct input module 415, allowing a 
direct selection of contents. Since a usefiil profile that truly represents the user's taste will 
only grow over time, there has to be a way to solve the 'cold start problem'. The first couple 
of choices for a new user cannot be made using the filter mechanism outlined above. So the 
first entries in P will result from direct selection. 
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A primary .mechanism for adaptation is the dynamic update of the sets P and 
optionally Q. But the visual appearance of the advisor should also adapt. A general proposed 
mechanism is the following: each of the behavior generating module 405, the motion 
generating module 406, the shaping module 408 and the rendering module 409 can be 
5 defined by means of a set of rules that generate a behavior, a motion, a shape and a rendering 
style. The shaping module 408 indicates a possible way of implementing and applying these 
rules. Every rule has a weight factor, and rules can by applied at random where the chance 
that a rule is chosen is determined by its weight factor. The rules should be such that 
whatever mles are applied, in whatever order, the total behavior is always according to the 
10 high-level goals, and the updates to user profiles and the filtering actions always take place in 
an appropriate way. Also, whatever the precise shape, defined by the shape-formation rules, 
it has always to be compatible with the stmcture as defined in structure module 407, since 

5^ this stracture is necessary to execute the motion patterns that together form the visual 

ID 

O representation of the database updates on the sets P and Q. 

V 1 5 Adaptation to the user's taste can now be realized through an evolutionary 

^ process, as follows. At specified time points, for example once per interaction session, some 
y random selections of rules is performed, and behavior, motion, shape and rendering styles are 
[[^ constructed according to the selected rules. All of this should generate a small number of 

different creatures which are all identical with respect to the semantics of the activities they 
jj«i= 20 perform in order to convey the system messages, e.g. database operations. They are, 

however, very different with respect to the further details of their behavior, their motions, 
their shape and their rendering styles. Next the user is asked to select one of these creatures. 
The weights or fitness of the rules that contributed to the generation of the chosen version are 
somewhat increased; whereas the weights of the other rules are decreased. A new generation 
25 of creatures is then performed, where the probability of using a certain rule is proportional to 
its fitness. In the next session, the exercise is repeated; where it is made sure that the 
preferred creature of last time is again among the offered alternatives. In this way, the user is 
certain that he never gets creatures that are a worse match to his taste than the previous time. 
In this process, the population of creatures evolves, together with the set of weights of the 
30 rules generating those creatures. It is assumed that the set of weights obtained in this way 
form a representation for the user's taste according to behavior details, motions details, 
shapes and rendering styles. If this can be confirmed, the mechanism will indeed lead to 
converging weights, and hence, to a creature that is adapted to the user's taste. 
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Generation of the shapes can be done through a combination of a shape 
grammar and non-linear warping. Shape gnunmars have been used extensively for describing 
shapes in a procedural way, as is known from for instance Lindenmayer, Aristid, 
Mathematical Models for cellular interactions in development^ I & 11, Journal of Theoretical 
5 Biology, 18, pp. 280-315, 1968; Prusinkiewicz, P., and A. Lindemayer, and J. Hanan, 
"Developmental methods of Herbaceous Plants for Computer Imagery Purposes", 
Proceedings of SIGGRAPH 1988, pp. 467-478; or M. Sonka, V. Hlava, R. Boyle, "Image 
Processing, Analysis, and Machine Vision", 1999, Brooks/Cole Publishing Company, Pacific 
Grove, CA (USA), pp. 315-323. 
10 A shape grammar consists of a finite set of substitution rules. A substitution 

rule has three components: a type name-substitution rule, a stmcture-substitution rule, and a 
shape-substitution rule. 

A substitution rule serves to substitute a shape segment by one or more other 

I- = 

O shape segments. A shape segment is, in its simplest form, a curve together with a 
£ 1 5 quadrilateral (ABCD) and a type name. A type name-substitution rule has the form 
!U <type name 0> — > <type name Ixtype name 2><type name 3> . . .<type name n>, for 
h4 instance: U->VU. 

ji^ The structxire-substitution rule and the shape-substitution rule define what the 

two curves, in this case, and the quadrilaterals are that together will replace the single shape 
20 segment with type name U from the left hand side of the type name-substitution rule. The 
structure-substitution rule and the shape-substitution rule that accompany the type name- 
substitution rule U->VU are defined graphically- This replacement rule is shown in Figure 5. 

The interpretation of this figure is as follows. Whenever this rule is to be 
applied onto an existing shape segment, this shape segment has to have name-type *U' (this is 
25 expressed by the left hand clause, 'U' in the type name-substitution rule U->VU). If such an 
existing shape segment, say ul, has been found, a transformation is constructed that maps the 
quadrilateral ABCD in the above figure to ul 's quadrilateral. It can be shown that such a 
mapping is a so-called bi-linear transformation. This geometric mapping is then applied to 
the two quadrilaterals in the right hand part: the dashed one and the dash-dotted one. The 
30 same geometric transformation is also applied onto the two thick curves (the solid curve and 
the stippled curve). These two curves will replace the original curve that belonged to ul. 
Further, ul's quadrilateral is replaced by the two smaller (transformed) quadrilaterals, the 
dashed one and the dash-dotted one. Finally, the name type 'U' for the entire segment ul is 
now replaced by a concatenation of two name types, and *U\ This means that in a next 
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round, the same i:ule coiild again apply to the right most newly created shape segment; 
however, in order to replace the left most newly created shape segment, we cannot use this 
rule. If no rule was provided that has the name type ' V in its left hand part, it cannot be 
transformed at all; in this case it is called a terminal symbol. If one or more rules of the form 
5 'V-> . . are provided, these rules could be applied at a later stage, and the shape segment is 
called a non-terminal symbol. 

As mentioned, it has particular advantages to specify the geometric 
transformation that will be applied by means of the structure-substitution rule in terms of bi- 
linear transformations, parameterized by quadrilaterals. Indeed, suppose that the shape 
10 segment that belongs to ul has a curve that starts in the point A of ul's quadrilateral and ends 
in the points D of ul 's quadrilateral. We observe that the two new curves then have the same 
property. So if the original curve was connected to the rest of the shape (that is, the rest of the 
shape connected exactly to the points A and D of ul's quadrilateral), then this connection is 
maintained throughout the shape segment substitution. Even stronger: suppose that the shape 
15 segment belonging to ul was tangent to AB and tangent to CD, and that the rest of the shape 
smoothly connected to ul 's shape segment in A and D (i.e., the tangent of the remaining part 
y of the shape in A was parallel to AB, and the tangent of the remaining part of the shape in D 

was parallel to CD), then this smoothness is also preserved. In other words, using structure- 
«V substitution rules that are parameterized by means of quadrilaterals, and that are implemented 

!M= 20 by means of the bi-linear mapping that maps the destination quadrilateral to the source 

quadrilateral, enables us to preserve, if so desired, cojinectivity (so called C^ continuity) and 
smoothness (so called C^ continuity). 

In this way, subsequent application of rules mimics the development of a 
complex shape out of a primitive shape. The following figures illustrate a part of the process 
25 that leads to the mles that should generate a complex shape. Figure 6 shows the final shape 
which a designer wants to obtain. Figure 7 shows a deconstruction of the final shape into a 
series of simpler shapes that represent the growth path leading to the final shape. In order to 
propagate fi-om one version to the next over this growth path the rules are needed. Figure 8 
shows how these rules are derived and cast in the form of substitution mles, including 
30 structure substitution in the form of appropriate quadrilaterals. 



